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ALL I ED, XQUKSELOB..P^RO tOXYPE 

tRAINIIiG..Pja6BAf!t 



there 1s an inadequate participation of minorities In the allied 
hHlth field, this situation Is one which demands the Immediate attention 
of those persons most directly Involved with steering students Into these 
;|rq^essipns • high school and college science teachers and counselors. 
tN*^;:must be a concerted effort on the part of counselors, science teachers 
.arid other interested Individuals to develop an appreciation for the role that 
|a6h;^lays In steering students Into these necessary and vital career fields. 

the basic objective of the training program Is to provide the necessary 
traihjhg^fbr the acquisition- of skills and information that will facilitate 
tht;deyelopTO of strategies for recruiting more minority and low socio- 
ecbhdrnic students into the Allied Health professions* Also, the program 
:prov1:ded an opportunity for high school and college teachers and counselors 
to exchange Ideas and information with students, other teachers and counselors, 
arid people actively engaged in Allied Health fields. 

_the workshop Involved the participants in various activities that will 
Enable them to be effective in implementing the program objectives. The 
didactic phase, clinical experiences, and practical applications Involved a 
mixture of theoretical presentations, media presentations formal arid informal 
exchanges, participatory clinical demonstrations and actual counseling sessions 

tfiat involved iiijjuL Troro StuutJntS, tcaChcrS, anu COUnSelorS. 

the resource consultants Included people Involved in the academic phase 
as well as the practitioners of Allied Health fields; recruiters in Allied 
Health programs ; employers and consumer representatives; people actively 
Involved in the study of barriers to minority and low socioeconomic group eritry 
into Allied Health careers; teachers Involved in the preprofessibnal Allied 
Health training. 

tntroduction 

this document is an indepth evaluation of the Allied Health Counselor 
training Program. An attempt will be made to examine the strengths and 
weaknesses of the program, 

Evaluation was a major component of the project from its inception. 
Behavioral objectives were developed in the planning of the project and used 
in all phases of the program irrplementation. 

flurpose 

the purpose of the evaluation was developmental and constructive. The 
program, as desianed, is a prototyoe for other programs to prepare teachers 
and counselors tc counsel students into the allied health professions. Thus, 
the evaluation was constructed to determine the effectiveness of the program 
in achieving that objective. Five specific avenues were approaches in the 
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(design-6f the evaluation Instruments which serve as a basis for this report, 
f lies e were: 

ii to determine biographical data about the participants; 

2; to determine the awareness of counseling techniques by the participants 
prior to the program such that a coifiparison could be made at the 
close of the training; 

,3'; to evaluate the effectiveness of the program format iffunediately 
after its completion; 

4. To determine attitudes of the participants toward the health sciences 
before and after the conference; 

to determine the level and qijality of participant activity in imple- 
mentation of the program and/or its concepts three months after the 
close of the activity. 

QfeganliZltion of the . Report 

Each section of the report is based on data directly solicited by ques* 
tiprihaires designed specifically to evaluate the different aspects of the 
pr*6gram. The sections are as follows: 

K Biographical data 

2. Participant Counseling Skills 

3« Participant attitudes 

4. Participant Awareness of Allied Health Careers 

5. Evaluation of the Presenters and Consultants 

6. Participant Perceptions of the Minority and low socioeconomic group 
Recruitment Problem 

7. Evaluator Program Suggestions 

8. Summary 

9i Three Month Fol low-Up of Participants in the Training Program 
Evaluation Procedure 

Four instruments were used in evaluating the Training Program. Each was 
designed to ovaHate one particular aspect of the process. At the beginning 
of the prcgrain each of the participants conpleted a pro-conference questionnaire, 
this questionnaire contained the follov/ing sections: 

1. Biographical Data (completed responses required) 

2. Attitude questionnaire (a seven point response continuum 
solicited attitudes on a wide variety of subjects) 
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3* Awareness of the Health Professions (cofnpletlon responses 
requl red) 



4; Perception of the Failure of Minorities and the disadvantaged to 
enter the Health Professions (cbifpletion response required) 

Si Program suggestions (open-ended response required) 

^ After the completion of each activity during the conference each 
.plrtlcipaht completed a Presenter/Consultant Effectiveness Form. A candid 
JValUatldn of the presenter and his presentation was to be made. 

At the close of the conference two forms of evaluation were carried 
out. Each participant completed a subjective evaluation of each presenta- 
iidn, and a post-test which followed almost exactly the format of the pre^test. 
Th6 similarity between the two instruments was calculated such that direct 
con)pairisohs could be made between the responses of the participants at both 
eftds of the training program, 

the evaluation is designed such that in the analysis, (1) describes tha 
prograni process, (2) indicates positive and negative portions of the program, 
^and (3) makes constructive suggestions designed to improve the model, the 
result of the evaluation is taken into consideration in the final design of 
th^ training program. 

Analyses Procedures 

the data from the four Instruments were analyzed primarily using descrip* 
tlve <tAti<^t1r<: . (bf*r;^u?;e of the very small oooulation involved). Combarisons 
Were made where necessary, and the statistical significance of differences 
xyikrt determined where appropriate. On all open-ended response items, results 
were verified by the use of two other evaluators. Correlations were run between 
the perceptions of the two additional judges and those of the evaluator. 

Limitations of the Evaluation 

Part of the data collected was supplied well after the events occurred 
thereby relying on the memories of the participants for accuracy* In this 
Way, limitations are placed on the evaluation. Likewise > when open-ended 
questions are evaluated there is always the possibility of misinterpretation, 
the sample size obviously makes generalization to the larger population un- 
realistic. 

Perhaps the major limitation is based in the self-imposed task of the 
evaluation - that of attempting to evaluate the effectiveness of the program. 
Realistically, the effectiveness of this program should be determined after a 

period cf three to five yeors irn1or':^ntation. Short term (none to t^r^^ 
years) effectiveness of the program will best estimated by what the particinonts 
are doing as a result of tho experience once they have returned to their 
individual settings. For this reoson of follow-up evaluation is built into 
the program at socetine toward the end of the academic year. 

All conclusions are therefore drawn with the limitations in mind. 
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SECTION ONE 



Btographlcal Data on Participants 



this section contains data relevent to the characteristics of the 
participants in the Counselor/teacher Training Program* There were eight 
(4) participants in the program at its inception. Two additional individ- 
uals joined the group later. Pre and post- test data are presented with 
toglirzShce of this difference in sample size. 

During the first session, subjects were told to choose any four digit 
numb#^ and to place that number on any materials turned into the program 
:c66i^dihators throughout the training program, 

^ariticipant Occupations 

Table I indicates that five (5) of the responding participants were 
teachers and three (3) were counselors. Two of the teachers were from high 
schools, three (3) were from colleges or universities. Three participants / 
were secondary school counselors. The two who came late were a college 
flcrUl ter-counseior and a high school science teacher. 

Experience of Participants 

Table 3 summarizes the years of experience which the responding par- 
ticipants had in their present positions. The mean years of experience was 
SiS, the range was 16, The majority of the group (5) had less than nine 
(9) years of experituce, Tliree hau twelve Oi mOre, 

Ahalysis and. Summary of Biographical Data 

An effective counseling system which seeks to improve the admittance 
of minorities into the health professions must contain input from at least 
four sources, High school teachers, high school counselors, college 
counselors and college teachers. The designers made a concerted effort to 
have representation from all four groups for an effective program. 

In future implementation of the program, it 1s suggested that a much 
more extensive evaluation of the backgrounds of the participants be taken* 
It became obvious, early during the conference that many of the participants 
were functioning at different levels, A concise evaluation of participant 
attributes prior to the conference would facilitate the selection and pre- 
paration of consultants and presenters. Sections of this report discuss this 
problem in some detail, 

It is suggested also that a concerted effort be made to recruit ex- 
perienced tCKiiers and counselors inic the training orogram. It is also 
suggested that school departr.ent heads, adn^inistrators , and others in positions 
that would F^ositivelv influcK^e the irriplementation of the program be recruited 
into the traininq program. 
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TABLE 1 
Participant Work Settings 
Setting Number 
Secondary 

School 6 

teacher 3 
Counselor 3 

College or 
University 4 

Teacher 3 
Counselor \ 

TABLE 2 

Breakdown of Participants by Sex 

Sex Number 

Male Z 

Female 8 

Total 10 

TABLE 3 

Breakdown of Subjects by 
Number of Years in Present Position 

Number of 

Years Frequency 

2 1 

3 1 
A 2 
9 1 

12 2 

17 1 

Mean « 5.9 

Total 47 , . 8 , Range = 16 

1 1 
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SECTION TWO 



Participant Counseling Skills 



This section relates data relevant to the general method exhibited 
byrpartici pants In handling themselves In counseling encounters with 
Students, the nature of the Instrument used In evaluating these behaviors 
necessitates some caution by the reader. The evaluation only speaks in 
J^effVterms about these behaviors such that accusations of research 
ifiipi^pflety will be minimal, 

^iescfeipltion of the Thematic Instrument 

While designing the evaluation Instruments the evaluator constructed 
four It^tements, In paragraph form, which sugg4sted association with a 
typcal: problem which a high school or college student would bring to a 
counselor or teacher. Each statement related to a slightly different pre- 
'blem ihd was Identified with a different type of student, (See p, Ap- 
pkhtiU . Participants in the training program were asked to read each 
staternent and respond to It In any theoretical or counseling frame which 
they desired. In order to facilitate a comparison between pre- and pbst^ 
conference responses, the same four statements were used In both questionnaires. 
As a preliminary step to evaluating the responses, the evaluator read through 
each of the pre-conference responses and determined several categories on which 
all w6u1d be evaluated* A copy of this evaluation form can be found In Ap- 
pendix D, , The evaluator then went through each response individually 
and checked off categories which were relevant to the response. Scores were 
accuitiulated for each response and across respcn::::, Two outside svaluator: 
with^research and counseling backgrounds were asked to repeat the process for 
verification, The pre- and post- conference responses were coded such that 
the two outside evaluators were not able to identify them, All responses for 
each statement (pre-and post-) were then intermixed and evaluated as a group. 
They were separated only at the point wherein statistical evaluation took 
pUce. Correlation coefficients were then computed between the scores of 
the three evaluators on the pre-and post- test responses. Tables 4 and 5 
depict these correlations, Relatively high correlations were found between 
the scores of the three evaluators on both sets of responses. On the post- 
test responses, evaluator B correlated ,852 with evaluator C; evaluator 8 
correlated .853 with evaluator A; and evaluator C correlated ,779 with evaluator 
A* Likewise, on the pre- test responses evaluator B correlated ,694 with 
evaluator Cj evaluator B correlated .812 with evaluator A; and evaluator C 
correlated .793 with evaluator A, (A perfect correlation approaches 1,000), 

Results 

The coi.foined scores of the three evaluators ere depicted in Table 6 
The data fror each of the check list iters ore dii^cussed below in terras of 
the mos t frequen tl.y vindicated choices on the seven evaluation items, 

"In terms of usefulness > the approach used by the counselor is--" 

Forty-one percent (40?0 of the responses to this item on the pre-test 
fell under the heading very generally usable> compared with sixty percent (60%) 
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TABLE 4 



Inter Evaluator Correlations on Counseling techniques Statements 

Pre- test 





Evaluator A 


Evaluator 6 


Evaluator C 


Eviluator A 


1.000 


.812 


.793 


Eviluator B 


.812 


1,000 


.694 


Evaluator C 


.793 


.694 


1.000 


TABLE 5 

Inter Evaluator Correlations on Counseling Techniques Statements 

Post-Test 




Evaluator A 


Evaluator B 


Evaluator C 


Evaluator A 


1.000 


.853 


.779 


Evaluator B 


.853 


1.000 


.852 


Evaluator C 


.779 


.852 


1.000 
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of the post-tost. Thus, the most typical response on the Item for both tests 
was the ^e ry. gene r a 1 . us a b 1 e response, It appears that the conference had 
some effect on the cbunseTing approaches of the f5art1ci pants. It is possible 
tliat the higher precentage of the post- test responses in this category indicates 
an increased awareness of appropriate counseling approaches. The evaluators 
-perGeived thirty-seven percent (37%) of the pre^test responses to be very^ 
narrow in approach, as compared with only twenty-seven percent {27%) of the 
post- test responses. Likewise, twenty- two percent (22/0 of the responses were 
perceived as not usable at all on the pr^e-test, corripared with only thirteen 
percent only on the post-test* 

.ConcVusjbn 

As a result of the training program, the participants appeared to have 
broadened their repertoires of possible counseling techniques. This indicates 
a positive correlation between the training program and the ability to develop 
useful :approaches to counseling. 



Table 6 

Compiled Sc::res on Allied Health Counseling Technique 
Pre and Post Test 



'JEvaluation 
Criteria 


Host 
often 
Indicated 
response 


Pretest 
Frequency 


Percent 
i 


Posttest 
Most Frequency 
often 
Indicated 
response 


Percent 




;1#Tn* t^nns of use fullness 
\ the appfoacb used by the 
^ dbunselor i s-- 

-very.-n arrow 




37 


37 


.26_ . 


27 


! ' -very generally 

^us,eabTe_ . . 


XXX 


40 


41 


XXX 59 


JO. 


i -not useable at 

all . 




22 


iz 


^ 12 . 


._.13 


^ S*D6es the counselor seem 
to have a clear theo- 
retical orientation-- 
-very, clear. 




6 


7 


15 


.17. „ 


•^clear _ _ 


XXX 


46 


47 


XXX 57 


59 


!^not„cxear ai ai i 


AAA 


45 


c 






3. In his approach to 
solving the individuals* 
problem, which of the 
following orientations is 
evidenced 

-an allied health 
emphails. 




23 


24 


XXX _ 64 


. 66 . 


•a general helping 
emphasis 


xxx 


50 


51 


19 


20 


-an undefined 
emphasjs 




24 


25 


13 


.14 


4iDoes the counselor 
indicate the use of the 
following references 

-persons in a part- 
icular field 




25 


22 


i 41 _ 


34. . 


-printed or written 
material 




33 


29 


i 

i US 


36 


-suggests no refer- 
ences at al 1 




56 


49 


1 

1 36 


30 . 
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table 6 (cont.) 



evaluation 
Criteria 


Most 
often 
indicated 
response 


Pretest 
Frequency 

— - - 


Percent 




Most 

often 

indicated 


Posttest 
Frequency 


Percent 


Ai\ terms of tech^ 
niqiiei the Goun^ 
seldr 1s=:= 

-giving friendly 
a<iyGe 




6 


- 

7 




- - - 


^ 

8 


-using aGcepted 
) counseling tcGh- 
niques 


XXX 


52 


54 


XXX 


66 


74. 


-using no ident- 
ifiable teGh- 
niques 




37 


39 




16 


18 


> U there a linear 
progress ion toward 
meeting the students 
needs-- 

rioav* l-jnos^v* 

♦ w» ^ I I 

progression 
















7 


8 




19 


_ 21 


-somewhat 1 inear 
progression 


XXX 


43 


45 


XXX 


47 


51 


-haphazard approach 


XXX 


45 


47 




25 


27 
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"Does the counselor seem to have a clear theoretical orientation--?" 



Seventeen oercent (17%) of the post-test responses indicated very cle ar 
theoretical orientation coa^pared with only seven percent (17%) on the pre-test. 
forty' six percent (46'^) of the responses indicated that the participants had 
a theoretical orientation on the pre-test compared with fifty-nine per- 

dent (59fO of the post-test responses* Forty-six percent (46%) of the pre-test 
responses were perceived as not clear compared with twenty-four percent (24^0 
oh the post-test* 

.Coh.oiusJ.oh 

The trainees appeared to have clarified and identified a theoretical 
perspective of counseling. However, it is suspected that the larger portion 
of iX involved a logical organization of thought patterns as a result of 
being given a wealth of usable information with which to aid students* 

"In his approach to solving the individuaVs problem, which of 
the following orientations is evidenced--?'* 

the evaluators perceived that fifty percent (50%) of the pre-test re- 
sponses were of a general helping nature, compared with twenty percent (20fO 
oh the post^test. Twenty-four percent (24^) of the pre-test responses were 
of ah Allied Health emphasis compared with sixty^six percent (66%) on the 
post-test. Twenty-five percent (25?^) of the pre-test and fourteen percent 
(145^) of the post- test responses were perceived as having an undefined 
emphasis . 

CajuCj^uSj on 

One of the training program^s major objectives was to make the participants 
aware of the need for a concerted allied health emphasis in their counseling 
activit^^. It would appear that, to a great extent, this was accomplished. 
They were quicker to transmit relevant data on the allied health professions 
to students because of an increased awareness of this type of information. 

"Does the Counselor indicate the use of the following references--?" 

Twenty- five percent (2b%) and thirty- three percent (33%) of the responses, 
respectively, mentioned the use of persons in e particular field and printed 
wri tten m aterial in counseling the stucent on Tr,e pre-test. The correspcndi ng 
percentages on the post-test were forty-one percent (41'i) and forty-five percent 
(45%). On the pre-test forty-nine percent (49^) of the responses suggested 
the use of no, references at all, while on the post- test only thirty percent (30:0 
failed to mention reference material. 

Conclusion 

There was a greater tendency for the participants to use reference 
materials in their counsoling in the post-lest situation than in the pre-test 
situation. Thus, they appeared to be aware of the fact that this 6t<tb was 
available. The progron rjnphasis in this area appears to have been accoral ishcd. 
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"In terms of technique, the counselor is—" 

Fifty-four percent (54%) of the responses on the pre-test were identified 
as havjhg an element which was identified as accepted counseling technique> 
as -coitipared with seventy-four percent (74?:) on the p6st test. The percentage 
of -those who were using no identifiable technique decreased on the post-test 
eighteen, percent (18%) as opposed to the pre-test thirty-nine percent (39?0* 

.Coficlusion 

Participants were very much technique oriented, Few fell into the use 
of .fpleri-dly advice in their counseling techniques. Participants apparently 
becaine aware of the use of some form of techniques in their counseling. Thero 
were some positive influences on the trainees as a result of having participated 
In the training program. 

"Is there a linear progression toward meeting the students* needs--" 

Forty-seven percent (47%) of the responses were perceived as being 
somewhat haphazar d in counsel ing appro_ach on the pre-test and only twenty- 
seven perGent^7Tro^^ Forty-five percent (45%) of the pre- 
test, fifty^one percent (5K) of post-test sppear as having a somewhat lin ear 
progression toward meeting the needs of the student. Eight percent (8%) oTThe 
pre-test and twenty-one percent (21^0 of the post-test responses possessed 
very_Glga,r 1i near progressi on toward meeting the needs of the student. 

Gonllusjon * 

there wbs an appreiable decrease in the use of haphazard counseling 
approaches between the pre- and post- test situations. It would appear that 
there was an intervening variable, i*e. the training program, between the 
two situations which had some effect on the methodology of counseling used 
by the participants, 

SuqqeSitions 

the participants irt the Allied Health Training Program appear to have 
come to the program with varied skills. Many were at a somewhat low level. 
Responses to the Counseling Skills Questionnaire indicate that the format used 
for the Training Program is an appropriate r.echanism for inproving the 
counseling skills of individuals. The following suggestions are made for 
improving the format: 

1. The emphasis on developing techniques for dealing with specific 

minority problems needs to be reemohasi zed. Minority categorization 

tcnd^> to bo ^,00 bread a orouoirn. Thr^^e r^re spocific oroblems 
within many of the different minority grouos which need to be con- 
fronted and orphasi;!od. If there is expectation of incrcasin.^ the 
number of Black and Spanish speakincj peoole in the health professions ^ 
for exairplc, then the program needs to face up to its emphasis 
on Black and Spanish sneaking people, 

18 
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More time should be spent on development of basic counseling 
techniques. Not only are there signs that this Is needed for 
science teachers but also for counseling personnel. Thus, It Is 
suggested that during the early phases of future programs more t1 
should be devoted to basic counseling techniques. 




SECTION THREE 



Participant Attitudes 



This section explores some of the general attitudes of the participants 
in the AVI ied Health Counselor Training Program, The questions were designed 
to determine the attitudes which the participants held relevant to certain 
perSonalt occupational and program expectations. Questions were included which 
would- elicit the set of the individuals toward these precepts, 

there were a set of twenty questions for. both the pre-and post-tests^ 
Subjects responded by indicating the intensity and direction of their feelijids 
t6wafd |ach item. Table 7 summarizes the responses to the items, 

the twenty items were designed to give a picture of the perceptions of the 
subjects ih five distinct areas. The responses are discussed under those five 
headings. 

1 • Role Perception 

2* Attitude Toward Counseling 

3. Attitude Toward Allied Health Education 

4. Perceived Skill Level 

5. Expectations 

Results 

Comparisons were made between the pre-and post- test responses. The "students 
test" was used to indicate some measure of statistical difference between the two 
sets of mean scores. These are displayed in Table 7* Only one item produced 
sufficient difference to indicate other than chance as an explanation of the change 
over the pre- and post-test situations. 

there were no significant differences on any of the items in the tests; therefore, 
the results of the pre- and post-test were combined and the following is a dis- 
cussion of this combination* Since the statistical results were not indicative 
of any trends, some subjective interpretation is included here* 

Role Perception 

Four questions were used to determine the attitudes of the participants toward 
their roles as educators (Questions 1, 14, 15 and 19). Participants disag reed 
strongly on the pre-test and only minimally on the post-test, with the contention 
that a teacher cannot do very much to motivate students to enter one profession over 
another (ITEM 1.) When asked, if they had experienced many of the frustrations of 
making a career decision which young people today are experiencing (Item 14), 
participants agreed only minimally on the pre-test and si ightly strongly on the 
post-test. (See Table 7) 
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Sufejfeets were asked If they were happy with their own career choices 
{Item }f)\ On both pre- and post-tests there was strong agreement that they 
wtre satisfied with career choices. 

item nineteen (19) attempted to determine if the participants felt confident 
that they could get ;he backing of their superiors in setting up a minority 
recrultntent program back at their own settings. Pre-test results indicated 
only itijinimal -.agreement . Post-test mean was interpolated to suggest strong agree- 
tnentt. 

Interpretation : Participants came to the training program with very positive 
ptrcep.tlons of their ability to motivate and positively Influence students. This 
itti^^ seem to be required if the counselors hope to be effective in 

influencing students as specified in the Training Program. 

the trainees appear to have reevaluated the processes involved in making 
career decisions. They were aware that they too experienced some frustrations 
Ifi this area» They were very consistent in their own feelings of satisfaction 
with their career choices* It is felt that in order for an individual to under- 
stand the perplexity which students face in choosing a career the counselor must 
havei at least* logically examined his/her own earlier decision making processes. 
An academic re-thinking of the process is desirable* The test data tend to 
confirm this reexamination. 

Participants felt that implementation of the program in their own settings was 
possible through their direct efforts. The data suggest that the program was 
Influential In development of confidence by Ihe paiUcipanU. Tins would be tjAnected 

the conference been successful In presenting a viable program. It is suspected 
that this was the case. Long-term (3-5 years) study of the behaviors of the par- 
ticipants will make it possible to confirm this conclusion* 

Attitudes. Toward Counseling : 

Five questionnaire items elicited data concerning the attitudes of participants 
toward counseling as a discipline (Items 5» 6, lU 15 and 17)* 

Participants strongly disagreed with the statement "there is very little which 
can be done to change the psychological set which minorities have regarding the 
difficulties of entering the health professions'* (Item 5). Pre-test and post-test 
responses were almost identical. 

The trainees were open to using the group process in working with students to 
inform them about the allied health professions (Item 6.) Likewise, they si i ghtly 
strong agreed that given the opportunity, they would feel perfectly comfortable con- 
duct! ng"^a "group experience'' with students (Item Ik), 

There was somev^hat of a consensus that counseling needs to concentrate on helping 
students in social and psychological areas more so than in academic areas (Item 15- )• 




interlpre.ta.tjon : The data from these five items suggest a strong belief 
In. counseling as a viable process for helping studoats to become fully functioning 
Individuals. It tends to support the assumption U.at the realm of counseling is 
In helping students in social and psychological areas, as well as academic, and 
that career counseling In its present form in ineffective. 



- Attitudel loward The Education Process : 

fW6 items gave some Indication of the general attitude of participants 
tdward; education (Items. 15 and 16). Subjects responded with slightly strong 
jgreeroent that students need counseling in psychological and social areas more 
so^ than* in academic areas (Item 15.). This is consistent with the response to 
the statement ''elementary and secondary education for minorities needs to get 
bick-to strict attention to the 'three r's* and away from attempting to meet 
tht personal needs of students" (Item 18.). The trainees only slightly agreed 
with this Statement. 

interpretation : The data seem to Indicate that the trainees perceive the 
lack of rudimentary skills exhibited by so many students as a failure of the 
educational process. v 

Perxelved: Information Base : 

Five Questionnaire Items sought the participants* perceptions of their 
ihformatibh base (Items 3» 8, 9, 12 and 13). There was agreement among the 
participants tnat tney had definite idedb about iiuw lu >uive the proulem of 
minority entry into the health professions. They, likewise, suggested that 
they had gained some definite ideas about the problems of minorities as a 
result of Involvement in the training program. 

At the close of the conference the participants indicated that they had 
a wealth of current knowledge about the many different health professions 
(Item 8.)» SimiTarly, they suggested that they were in possession of a good 
working knowledge of group processes (Item 9.). 

the end of the conference also found subjects in possession of an 
aviareness of what most career development specialists have to say about 
career decision making (Item 12.). They also strongly agreed that they 
Were aware of the high school requirements necessary for entry into the 
health professions (Item 13.). 

Genera-l Nummary : 

A point must be made concerning the failure to achieve sufficient 
significance levels on the twenty attitude items. In overy instance, there 
was a higher interpolated mean score between the pre- and post- tests, suggesting 
that there was increased awareness or competence on the part of participants, 
the failure for this difference to show statistically can be attributed to 
two factors: 
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1^ the size of the sample was so small as to give too great a weight 
to each score. The result was that extreme scores had disastrous 
effects on other more likely scores; 

Zi the nature of the response continuum contributed to this effect as 
.well. The seven possible responses allowed for greater dispersion 
than would have been preferred. 

WUh^these limitations in mind, the evaluator concluded that the Training 
Program format did contribute significantly to the change and/or development 
of attitudes of the participants. 

Pt.ogramJuggestions : 

The following program suggestions have resulted from this summary of 
attitude items; 

A direct and concerted effort should be made to confront some of the 
Issues affecting education and counseling generally and these should 
be included as a part of the Training Program* Such issues as: 

a. Place of education in society 

b. Minority education-successes and failings 
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SECTION FOUR 



:Participdnt Perceptions of the Failure of Minorities to Enter 



the Allied Health Professions 



this section discusses the notions which the participants had concerning 
the failure of minority individuals to enter the allied health professions, 
the results from the pre-test situation suggest the ideological shadow under 
which tfie counselors and teachers have been working in dealing with students, 
the post-tfest suggests a perceived enlightenment about the problem which has 
felul ted from the influence of the Training Program. 

Barriers to Entry of Minorities into the Health Professions as Perceived by 
^arJ;icip,afits_At the Beginning of the Conference 

the participants were asked to draw upon their experience in working with 
students and determine their best perceptions of the reasons why minority 
individual's have not been admitted into the health professions. Table 8 
summarizes this data. The participants were given eight choices and were also 
instructed to indicate other barriers which were not included in the 11*^ 



By indicating a f irst,„second and third most significant barrier , it was 
possible to rank the barriers chosen by the participants. When the three 
responses were weighted, the following ordering was exhibited: 

Most significant barrier: Lack of adequate information on 



Second most significant 
barrier: 



Lack of educational background 



Third most significant 
barrier : 



Irrational fear of scientific 
disciplines 
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TABLE 8 



RANKING OF BARRIERS INDICATED BY PARTICIPANTS AS SIGNIFICANT 
TO FAILURE OF HlflORITIES TO ENTER THE HEALTH PROFESSIONS 

Pre-Conference 



Barrier 


Rank 


Wgt.'d 
Freq. 


Freq. 


Lack of adequate information on 
these areas 


1 


16 


7 


Laek bf educational background 


2 


7 


3 


Irrational fear of scientific 
disciplines 


3 


Q 


4 


Institutional efforts to keep 
them out 


4 


3 


1 


Lack of encouragement from 
teachers and counselors 


4 


3 


3 


Lack of inner motivation 


4 


3 


1 


Lack of encouragement from home 


5 


Z 


1 


Lack of financial support 


6 


1 


1 
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The group, thus, seems to place much of the problem with the school. 
It is perhaps interesting to note that lack of financial support ranks low 
on the list of perceived barriers. 

BanrJ.ers^to, Entry of Minorities into the Health Professions as Perceived .at 
the:^End^.bf,J>he Jrajning Program 

The participants in the program were asked to summarize their perceptions 
9f the barriers which minorities face in entering the health professions at 
the close of the program. The questionnaire provided three fill-in response 
itenis in. which participants were asked to list the first, second, and third 
most significant barriers which minorities face in attempting to enter the 
health professions. These responses were interpreted by the evaluator and 
.ranked as a group into the data presented in Table 9. The top three responses, 
Whick resulted from a weighted calculation, were: 



Most significant barrier: 



Lack of adequate information 
on these areas 



Second most significant 
barrier: 

Third most significant 
barrier: 



Irrational fear of 
scientific disciplines 

Lack of encouragement from 
teachers and counselors 



The participants, at the close of the conference, placed the blame for the 
failure of mure miiiui ities to enter the health prcfcscicr.i: cn lack of informat^'nn 
or misconceptions about the information related to the health professions. They 
perceived the problem more from the student's perspective, suggesting that the 
major area for counselors to concentrate in correcting this situation is the 
presentation of correct information to students* 

Three additional areas were mentioned as problem areas which were not mentioned 
on the pre-test. These were: 



Rank 4 



Lack of self-awareness 



Rank 5 



Students don*t like science 



) 
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TABLE 9 

Ranking of Bapriers Indicated by Participants, as 
Significant to Failure of Minorities 
To Enter the Health Professions 
Post - Conference 



efs 



Rank 



Wgt.'d 
Freq.s 



Frequency 



kaekiof- adequate Information on 
areas 



Irrational fear of scientific 
disciplines 

Lack of encouragement from 
teachers and counselors 

Students feel you have to be 
a brain In these areas 

Lack of self awareness 

Uc-k of financial support 

Lack of educational background 

Students don't like science 

Not willing to sacrifice time to 
reach goal 



2 
3 



4 

4 
4 
5 
7 



13 

7 
4 



3 
3 
3 
2 
1 



5 
2 



1 
1 
2 
1 
1 
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Rank 6 Students were hot willing to sacrifice the time required 
to achieve a position in one of the health professions 

It Is interesting to note that "institutional efforts to keep them out" was 
not suggested by the participants at all, 

Summary and Conclusions 

A. Spearman Rank order correlation coefficient was computed on the two rankings 
(]prerand post-test}* This computation indicated a Spearman Rank of •548 which 
suggests that it is highly unlikely that there is no correlation between the two 
f^ankl (at the .05 confidence level a point of ,564 was required). It does, however, 
suggest that the participants were in possession of a keen awareness of where 
the problem of minority participation in the health sciences lies. Likewise, the 
data would suggest that there was an extending of the thinking of the participants 
such that they identified other problems than those initially brought to the 

^RecofTOgndalio ns: 

the following reconunendations are made as a direct result of the- data received 
from this section of the report: 

1, More attention needs to be paid to building upon the perceptions and 
resources of the participants in designing the experiences which the 
conference will include, A pre-test as suggested in the last section, 
which would look at the knowledge which the participants already have, 
would allow for more effective planning. 

2, Having practicing professionals on a panel which actually discusses 
the problems which they faced in entering the health professions would 

be a useful tool in clarifying many of the problems for the participants* 

3» there should be further study in the barriers to entry and implementation 
of means to alleviate them. 



Personal View of Evaluator 

Counselors are not adequately prepared to provide the information necessary to 
motivate students to enter these areas. Students are not adequately prepared by the 
schools to meet the challenges of health career training. Students have been instilled 
with an irrational fear of science. It should be clear that if the groups perceptions 
are accurate, then students will never get to the point where they try these careers 
until the situation is cleared up back at the elementary and secondary level. 
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SECTION FIVE 
Participant Awareness of Allied Health Careers 



During the clinical phase of the trainiag program, the participants were 
introduGed, in depth, to many of the allied health careers through presentations 
made ;by health professionals and through actual participation in practical 
experiences. This section concerns itself with the awareness which the parti - 
^i^an|§ have of the allied health areas. It explores this awareness prior to 
tfii :beginnirig of the conference and at its close. 

BfMMfereAce Awareness 

in the preconference questionnaire the participants were asked to identify 
as many areas as they knew of which could be classifed as health careers. Table 
iuirinarizes this data. 

it will be noted that the majority of the subjects identified only eight (8) 
careers (the number following the career represents the frequency of identification) - 

^ physical therapist (7), Dietician (7) Doctor (5), Nurse (6), Medical Technician 
16) i Inhalation Therapist (5), Dentist (5), Dental Hygienist (5). A total 
of forty-one (41) health careers were identified. However, most were identified 
by only one of the participants. 

As a consequence of identifying the career, the participants were also asked 
to indicate whether oi not they had sufficient irifcrn;aticn tc counsel studerits 
about the career. Table 10 indicates that in only two areas did the majority 
of the participants feel thay they had sufficient information to aid students, 
those careers were doctor and nurse. Only in twenty (20) careers v/ere one or more 
of the participants confident in their knowledge of the career to a level wherein 
they felt they could aid students. The group indicated that they lacked the 
necessary information to counsel students in the remaining twenty one (21) careers 
which were identified. 

Post Conference Awareness 

Twenty-seven (27) health careers were included as part of the Training Program. 
Information was disseminated in the form of clinical sessions with a practicing 
professional, handouts and prepared materials by the program developers in the 
form of a manual. The participants were asked at the close of the conference to 
identify the competence level at which they perceived themselves in ability to counsel 
students effectively in these twenty-seven areas. Table 11 summarizes these results. 

All participants indicated nigh to very high competence in their perception 
of their abilities to counsel students. Those areas in which clinical seminars 
were held appear to have solicited some what higher competance estimates from the 
partici pants. 
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TABLE 10 



SUMMARY OF DATA RELATING TO PARTICIPANT AWARENESS 
OF HEALTH CAREERS PRIOR TO THE BEGINNING 
OF THE CONFERENCE 

Health Career Freq. of Number of Participants 

Identification who Indicated having 
sufficient information 
. - - to counsel students 



Physical Therapy 


7 


2 


Nutrition ht/Oietitian 


7 


4 


Doctor.... . 


6. 


6 


furse / 


6 


6 


MedlcalU.boratory Technician 


6 


5 


Inhalation Therapist 


5 


1 


Dentist 


5 


4 


Dental Hygienl St 


5 


1 


X^Ray Jichnlclan 




2 


Nurse Aid 


3 


2 


Radiologist 


3 


1 


PHarftacist ^ 


3 


2 


Uboratofy Technician 


3 


1 


Health Care Administrator 


2 


2 


Occupational Therapy Technician 


2 


0 


tiental Laboratory Techni^^i^n 




z 


Waro Clerk 




1 


enUd^Care Specialist 




0 


Ksycniatrist 




0 


cytplpglst 




0 


nuaio 1 og 1 St i ecnn i ci an 


■ 3 


0 


cnvAronrnenia i bpeci a 1 1 st 




0 


Marine Biologist 




0 






u 


Chemist 




0 


Respiratory Technician 




0 


Pathbloqist 




0 


Microbiblogi st 




0 


Psybhologist 




0 


Medical Librarian 




0 


^Pediatrician 




0 


Podiatrist 




0 


Optornetrist 




0 


Oculist 




1 


Sanitarian 




1 


Para-'i^iedical Assistant 




0 


clinical Lab, Assistant 




0 


Hospital Administrator 




0 


Dietary Aid 




1 


Veterinarian 


1 


1 


Surqeon 


1 


0 
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TABLE n 



SUMMARY OF DATA INDICATING COMPETENCE LEVEL OF 
PARTICIPANTS IN COUNSELING STUDENTS AFTER 
PARTICIPATION IN THE CONFERENCE 



Health Career 


Mean 


No. 


Interpolated 


Technician 
4fthaUti6n Technician 
JBhalatiion Thprani^t 


5.71 

5.88 

5 88 


8 

8 
8 


Above Average Competence 
Above Average Competence 


CptqiTietric Assistant 
Optpnietrlst 
Dental Hvoenlst 


!5.75 
5,75 
6 75 


8 

8 
n 


Above Average Competence 
Above Average Competence 


ffedlcal Laboratory Tech. 
HIBlcal Technologist 
CvtoteGhnolooi st 


'6.75 
6.75 
6 73 


8 

8 
8 


High Competence 
High Competence 


Medical Assistant 
Mje^dical Record Technician 
Medical Record Admin, 


6*57 
6.25 
6.38 


8 
8 
8 


High Competence 
High Competence 
High Competence 


Certified Technician 
Radiologic Technoloqist 
Nuclear Medicine Tech, 


6 00 
6.50 
6.25 


8 

8 
8 


High Competence 
Hi ah Comoetence 


Electroraraiogrf^pliic Tech. 

Dentist 

PharmlGist 


5.88 
6.38 
6.13 


8 
8 
8 


Above Average Competence 
Above Average Competence 
Above Averaqe Competence 


Operating Room technician 
Physical Therapist 
Physical Therapist Assist* 


5.50 
6.63 
6.75 


8 
8 
8 


Above Average Competence 
High Competence 
High Competence 


Veterinarian 
Dietetic Technician 
Registered Nurse 
Licensed Practical Nurse 


5.38 
6.38 
6.13 
6.13 


8 
8 
8 
8 


Above Average Competence 
High Competence 
High Competence 
Hicih Competence 


Sanitarian 
Dietitian 


5.63 
6.13 


8 
8 


Above Average Competence 
High Competence 



1»P0 to U50 No Competence at all 

1.51 to 2.5 Little or no Competence 

2.51 to 3.5 Low Average Competence 

3.51 to 4.5 Average Competence 

4.51 to 5.5 High Average Competence 

5.51 to 6*5 Above Average Coii^petence 

6.51 to 7 High Competence 
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Data seems to indicate that the participants In the Allied Health Counselor 
Training Rrbgram possessed little usable knowledge of the many areas in the Allied 
Health field. The conference process seems to have been somewhat effective in 
.providing the needed information to improve -the competency levels of the partlci- 
.pants in-cbunseling students in the health areas. The following suggestions, 
however, are made to improve the information disseminating format and the method 
of determining the effectiveness of the prototype in providing that information: 

1. At some time prior to the arrival of participants at the site of the 
training program, and preferably prior to the planning of the conference 
activities, participants should be identified and questioned as to their 
backgrounds and training. It should be obvious, if this is done, that the 
Strengths and weaknesses of participants can become a significant part of 
the planning of the training program. 

2. it is suggested that a more direct format be determined for facilitating 
the presentation of information on those careers not covered by a clinical 
seminar. There appears to be some benefit to making a formal presentation 

, about the areas, over just providing the information in a manual. One 
suggested method for doing this would be preparation of a seminar or series 
of such, at which all of the clinical areas which do not have individual 
seminar sessions included in the program are presented. A good film could 
do this quite adequately, 

3. Preparation and presentation to the clinical presenters of a rather specific 
and detailed outline of expectations would remove some of the ambiquity 
which was indicated by the participants (this problem is discussed in 

a later section of the report.) 

4. A more effective means of evaluating the content which is effectively 
incorporated by the participants needs to be developed. This should be 
a short term as well as a long term goal. 

5. Time should be provided which is for the specific purpose of letting the 
participants discuss among themselves the activities provided by the clinicals 
(as was done in the evening sessions or reinforcement activities explained in 
the traning manual). 
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SECTION SIX 



Evaluation of the Presenters and Consultants 



this section provides an evaluation of the presentations which 
were made during the Counselor Training Program. Participants completed 
a questionnaire concerning the effectiveness of each presenter and 
f re|entation. They were asked to Indicate the direction and degree of 
-th61r feelings about the presentation. Secondly, a summary, subjective 
fyaluation was completed by each participant at the end of the conference. 
Participants were asked to state positive and negative points about 
e|ch presenter and his presentation. Thirdly, the evaluation component 
6f iSE made evaluations of the presenters. The overall suintiary is 
discussed below. 

Sunitiary; 

The presenter/seminar evaluation was completely subjective and 
open-ended. Subjects v;ere asked only to identify positive and negative 
points about each presentation. This section Interprets the statenients 
by the participants for the purpose of program development. The majority 
of the participants were concerned about the following issues as evidenced 
by their evaluative comments: 

U Quality of the Presentation, Where problems were mentioned, 
the organization of the presentation tended to be a large part 
of this concern. 

Recommendation: It is suggested tnat a great de<il uiure unifutuuty 
of presentation and organization of material should be required 
of seminar and clinical presenters. 

2* Enthusiasm of the presenters. In most instances^ participants 
p1cked*up on the level of enthusi am which presenters brought 
to their tasks. Where there was lack of enthusiasm, the 
presentation suffered. 

Recommendation: A more careful screening should be made of 
those individuals who are chosen to make presentations. This 
would Involve compiling a list of individuals who are proven 
competent in this area or some form of direct interview or 
observation of each by program presenters. 

3t Time allotted for presentation and discussion. 

Participants were concerned in a number of instances v/ith the 
lack of sufficient time to no into depth with the seminar tonics. 
Where depth was achieved, there tended to be insufficient time 
for discussion. 

Reconmendation: Two possibilities exist for correcting this 
problem. One, the hour-end-a-half format, which U'as adhorrod to, should 
be extended to two-hours-and-a-half . Two, the program's evening 
sessions, df^scrihed in trainer's manual, would provide the additional time 
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Mode K presentation. 

Participants saw three areas in which they were concerned with 
respect to the inethods of presentation which were used by the 
presenters. These areas were (a) insufficient use of audio- 
visual aids (b) presentation of lecture too structured 
(c) presenter promised additional materials but failed to 
follow- through. 

Recommendations: Concerns (a) and (b) could be attributed to 
the time schedule of the program. Concern about promised 
materials never arriving could be handled by assigning a 
support person to keep note of these areas and see that the 
consultants follow-through. 
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TABLE 12 



PARTICIPANT PERCEPTIONS OF AREAS WHEREIN THE ALllEO HEALTH TRAINING 
PROGRAM COUNSEL INS SEMINARS AND/O!^ PRESENTERS WERE 

EFFECTIVE 



Positive Sections of the Presentation 



Number of times Percent of totil 
point was responses 
mentioned 



Participant Indicated that excellent material was presented 
during the seminar 

Participant Indicated that the presenter was sympathetic and 
understanding to the needs of the group 

Participant perceived that the presentation was well organized 

Participant Indicated that the presentation was very informative 

Participant indicated that the Information provided was irteresting 

Participant indicated that the presenter(s) was/were personable 
and enthusiastic 

Participant indicated that the presenter(s) was were good facilitators 
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2 
4 

2 

15 
4 

16 



46« 
Z% 

2X 
18X 

5% 

20% 
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TABLE 13 

PARTICIPANT PERCEPTIONS OF AREAS WHEREIN THE ALLIED HEALTH TRAINING 
PROGRAM COUNSELING SEMINARS ANO/OR PRESENTERS WERE 
INEFFECTIVE 



Presentation Failure 




Number of times 
failure was 
mentioned 


Percent of total 
responses 


Participant Indicated no fallings of the presentations 




20 


33% 


Presenter used poor techniques: Read too much, lectured, filled to 
give feed back, failed to send pron>ised materials. 


7 


lU 


Presenter not well organized: Objectives not clear, materials 


Inadequate 


13 


25% 


Presenter not willing to accept ideas of participants 




15 


26% 


Presenter outlook unrealistic: inconsistency between word md 


action 


6 


10% 
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TABLE 14 



PARTICIPANT PERCEPTIONS OF AREAS WHEREIN THE ALLIED HEALTH TRAINING 
PROGRAM CLINICAL SECTIONS AND/OR PRESENTERS WERE 
EFFECTIVE 



Positive aspects of the presentation 



Number of times 
point was 
mentioned 



Percent of total 
responses 



Participant indicated that excellent material was presented 
during the clinical 

Participant indicated that the presenter was sympathetic aid 
understanding to the needs of the group 

Participant perceived that the presentation was well organized 

Participant indicated that the presentation was very informative 

Participant indicated that the information provided was interesting 

Participant indicated that the presenter was very personable 
and enthusiastic 

Participant indicated that the presenter was a good facilitator 
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2 
22 
4 
1 

25 
2 



47% 

2% 
21% 
4% 
1% 

24% 
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TABLE 15 



PARTICIPANT PERCEPTIONS OF AREAS WHEREIN THE ALLIED HEALTH TRAINING • 
PROGRAM CLINICAL SECTIONS AND/OR P'^ESENTERS WERE 
INEFFECTIVE 



Presentation Failure 


Number of times 
failure was 
mentioned 


Percent of total 
responses 


Participant indicated no failings of the presentation 


32 


64% 


Presenter used poor techniques: read too much, lectured, failed to 
give feed back, failed to send promised materials. 


6 


12% 


Presenter not v/ell organized: objectives not clear, materials inadequate 


11 


22% 


Presenter not willing to accept ideas of participants 


1 


2% 


Presenter outlook unrealistic: inconsistency between word and action 


1 


2% 



) 
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Participant Over-All Conference Evaulation 



The Training Program participants completed seven questionnaire 
Items at the end of the program v/hich asked them to give a general 
evaluation of the different aspects of the program^ Table 16 depicts these 
responses. The data suggests that all asp'ects of the Training Program 
were well received by the participants. 

TABLE 16 

SUWARY OF OVER-ALL CONFERENCE EVALUATION 
ITEMS 



Item 


Mean 


Interpolated 
Mean 


1. The seminar topics were 


5.88 


Slightly relevant 


2. The seminar presenters were 


5,86 


Slightly relevant 


3* "''he conff»^<*nrf! wa^ 


5.71 


Slightly well 
organized 


4» The conference setting was 


6.71 


Excellent 


5, The materials passed out were 


6.71 


Very relevant 


6, The ISE staff was 


6.57 


Very helpful 



7. My accommodations were 5.57 Good 



SECTION SEVEN 



Participant Perceptions of the Minority Recruitment Problem 

This section contains data relevant to perceptions which the partici- 
pants had at the beginning of the conference Cvoncerning the failure of 
minorities to enter the health professions* It is included here as a separate 
section for two reasons* One, it is a candid perception, in their own lang- 
uage, by each of the participants of their evaluotion of the problem prior 
to the beginning of the training process. It, thus, expresses the depth 
of thought which the participants had been involved in and the mechanisms 
they had called upon in their counseling when confronted with the issues 
in their jobs. Inherent, also, is a level of expertise and evaluative skill 
which each possessed. The participants were asked to respond to two free 
response questions in any way which they desired* Each question and actual 
(unedited) response of the subjects are included below. 

In as many words as you feel are necessary, define the problem. 

Reply #^775-4164 The problem is that there is a lack of information and 
awareness a counselor to intelligently help students to 
make wise decisions in areas of health careers. 



Reply ^1729 The problem is that according to the total population of 

minorities, a very small number of them are entering 
the health fields. 

Reply ^1547 The problem is one of changing attitudes about who should 

coter voiious healtli professions ar,d the level of difficulty 
of cours6 requirements (in high school and college.) 

Reply #7777 Most of the students entering Med. Technology (one exairtple) 

have no idea what a medical technologist is or what the 
requirements are to complete this curriculum. They have 
seen people working in a laboratory and think this is 
impressive. But all students want to avoid math, biology, 
and chemistry the first year of collegec 

Reply #2575 1. Poor self-concepts among Black students 

2. Lack of information regarding careers, higher educational 
opportunities and financial resources. 

3. Minorities experience poor educational experiences; are 

not exposed to a variety of extra-curricular activities which 
lend support to academic experiences, etc. 

4. There are no planned programs for recruiting students into 
the health profe*^sions. 

5. The lack of knovrieocje dboui hcdlth carGcrs, city counselors 
and the lack of ti:^e to \/orU adcciuately v;ith iiiinoritics^ 

Reply r^2210 The problem is minorities ore not adequately represented in 

Allied Health fields. There is o need for them in heoHh 
careers as well as service to their people. 
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Reply #32427 There is a need for more individuals to enter Allied Health 
Careers, Despite the need for more trained personnel, fewer 
Blr.'^ks are entering. 

Conclusions: 

The participants in the Training Program tended to identify the problem 
of minority entry into the health fields as one of lack of information by 
students about the fields and the failure of teachers and counselors to 
be knov/ledgeable in providing this needed information. There is an obvious 
recognition of the need for improving the numbers of minorities in these 
areas, however, for the most part no new insights can be gained from the 
defining of the problem by the participants at the beginning of the conference. 

It is the intent of the evaluator to use the responses of the participants 
in evaluating their behaviors at a time in the future. At that time each 
participant will be asked to identify the problem again. Comparisons will 
then be made between the two sets of responses for the purpose of determin- 
ing growth, or any new thinking which the participants have acquired over 
a longer period of time. 

Provide what you see as a solution to the problem (Actually organize a 
program for solving the problem) 

Reply #775-4164 Orientation of counselors, administrators and teachers of 
all the needs, opportunities and financial aid for black 
s^iidpnts in hfjalth fields. 

This should be started (with the students) at the elementary 
level , 

The solution to the problem may be: 

In Junior High school, specifically the eighth grade when 
the 15 career clusters are presented, make a special effort 
for health careers such as: 



Reply #1729 

1, 



a. Movies - Health Council has some good ones, 

b. Speakers - Those from whom students can use as a model. 

c. - Emphasize the educational goals necessary to enter a 

health career, specifically, science and math. 

2. After presenting the information to the whole groups-divide 
the groups into interest areas and go into it in more depth. 

a. Field trips to local hospitals. 

b. Research in the library duriny class time, 

c. Encourage students to talk to people working in that field. 

In the tenth grade tho %c^v^q process dS the eighth qrade 
should be repeated to pick up those youngsters who are not 
sure. To enhance and moke clear the goals of those students 
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who are committed to a career in the health field. 

Also in the ninth grade a good tutoring system should be 
Initiated to help those students over the first six to 
eight weeks in algebra and biology. 

Also, I feel in-service training for science teachers is 
needed. I don't feel 'their subjects are as hard as they 
make them to be. At least I have not found it to be so. 

Reply J^1547 We need to provide workshops and group sessions dealing 

with our concepts, attitudes, and n\yths about black children^ 
We need to address counselors to the various careers available 
in specific areas and the requirements, duties, expectations 
of these specific career areas. We also need to do some 
on-the-job observations for the purpose of determining 
v/hat is expected in the world of work, be it health related 
or industrial • 

Reply #7777 Make students aware of the rigid self discipline and study 

habits they have to acquire during high school so that when 
they arrive on the college campus they are ready to 
achieve the high scholastic standings required to satisfact- 
orily complete the programs. Many students are capable 
of achieving a higher scholastic average but many fail to 
pursue them until they are Jrs,, or Srs, in college. 
Many students have told me, "If I would have realized I could 
nnt pnter Med. Tech, • with a "C" average, I would have 
stayed up a few nights and studied"! 

Reply ^2575 Due to time I will briefly suggest an outline of a program 

for solving the problem: 

1, The follo\"/ing elements should be considered for any program 
developed to recruit minorities into the health professions: 

a. An indepth conceptualization of the Black experience 
and how it relates to career development for minorities, 

b. A comprehensive program that begins at the elementary 
level and is expanded through junior and senior high 
and includes the college level, 

c. The development of various media-written and audio/ 
visual to provide concrete information to students 

concerning specific ceroors » dovelopiront of self- 
awareness ^ and areas related to general career develop- 
ment. 

d. A diverse progrtim consisting of individual counseling; 
group discussions; field trips; interviews; various 
audio/visual displays; media; speakers; and instruments 
for developing self -awareness. 
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A program that includes consistent and adequate 
counseling throughout a studc^U's educational experiences, 

f. Though one may develop an e^cellenv counseling program, 
the curricular should be supportive of goals • 
Minorities are often limited by a poor curriculum or iiH 
sensitive teachers. 

Reply #2210 In order to solve this problem minorities must be en* 

couraged, to an acceptable degree* to enter Allied Health 
fields^ 

1, Administrators should be made aware of the problem 
as well as the means for solving 1t» 

Design a program to familiarize teachers, whose subject 
matter is directly related to health professions > with 
the requirements and responsibilities of these pro- 
fessions, 

3. Counselors should have a "working" knowledge of the 
responsibilities of various health professions. 

Reply i?2427 An awareness conference on the various occupations In 

Allied Health for administrators, counselors, teachers, 
and students. 

Small group counseling of students with an interest in 
Allied Health, 

Individual counseling for students to elect courses that 
will prepare them in an Allied Health Career. 

Mini-course for Introduction to Allied Health Careers, 
Grouping of these students. 

Conclusions: 

The solutions which the participants provided to solving the problem 
of mtnority participation in the health sciences tended to emphasize the 
need for getting prcpi^r infon.:(^tion into tli^ hands of students, counselors, 
teachers and administrators. The responses discussed here perhaps give 
the best estimate of the exptclotions of the participants of the convsrenco. 
It v^ould appear that these expectations and those or the conference organizers 
are congruent. 
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SECTION EIGHT 



Points to be Stressed (Evaluator^s View) 



This section pulls together the many suggestions which were made by 
the evaluation team as a result of examination of the three questionnaires 
and personal observation (by one evaluator) of the training process. 

The general consensus of the evaluation team is that the process has 
great merit for acconplishing the goals wfiich were set. The foUwing sug- 
gestions are offered: 

1, Clear and concise objectives need to be stated for each of tl\e 
seminars and presentations such that there is no confusion with 
respect to the consultant understanding his/her task. Some form 
of contract system needs to be established by which the program 
states its objectives and sends th^m to the consultant. The con* 
sultant, in detail, then states his objectives and the mode of 
accomplishing them, signs the contract and returns it. These 
should then be carefully scrutinized by the program developers 
for match with established objectives, 

2, Emphasis should be placed on developing skills in dealing with 
specific minority problems. Facing up to the fact that minority 
Implies black, Spanish speaking or any other specific minority 
can directly alleviate this problem, 

3, More time should be spent on developing specific counseling 
techniques. The diversity of backgrounds warrants this conclusion. 
Some form of pretest would give an indication of the depth with 
which counseling skills should be dealt, 

4, A means should be available to incorporate the pretest findings, 
profile information, and other feedback from the participants 
into the selection and structure of seminars and presentations, 

5, By effectively using tours of various health facilities, more 
careers could be introduced, 

6, The training process should include opportunities for discussion 
of the techniques and information presented in the sessions. 
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THREE MONTH FOLLOW-UP OF PARTICIPANTS IN THE ALLIED HEALTH 

TRAINING PROGRAM 
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THREE MONTH FOLLOW-UP OF PARTICIPANTS IN THE ALLIED HEALTH 

TRAINING PROGRAM 



INTRODUCTION 

Approximately three months after completion of the Alliod Health 
Teacher-Counselor Training Program, the eight participants in the program 
were sent a follow-up questionnaire. There were several specific objectives 
for gathering this Information: 

1. The training program was a prototype. It was designed to serve 
as a model for other similar programs. Thus, prior to further 
implementation, the designees wished to determine any long term 
effects which it had on the participants, 

2. The participants were encouraged, during the training program, to 
design a program for implementation in their own home settings. 
The follow-up was thus, designed to determine the Involvement of 
the participants in implementation of their programs* 

3. Supervisors, administrators and teachers were to be a part of the 
participants* designed program. The follow-up attempted to determine 
the attitudes, perceptions, and suggestions which these individuals 
had. 

DESCRIPTION OF THE DATA GATHERING INSTRUMENT 

The oarticipants were mailed a questionnaire which solicited subjective 
judgements concerning the experiences which they had in the Trainiiiy rruyiauu 
Fifteen specific items sought responses related to these perceptions. 
This follow-up evaluation is discussed using these fifteen items as major 
headings. Seven participants returned the questionnaire at the time of 
compilation of the report. 

DESCRIPTION OF RESULTS 

"What aspects of the January Training Program have you found to be 
most useful?" 

Typical responses included the following: 

• Being exposed to the various health fields. 

- Being able to experience the actual setting wherein health 
professionals work. 

- Being able to talk with and exchange ideas with individuals like 

myself from othrr j^chool systcp^s. 

• Being given the means for gathering information about health 
professions. 



5; 



Conclusions: 



The participants suggest that the experi ices they gained during 
clinical sessions of the program were mos.. useful to theoi in their 
jobs*! The meariingfulness of actually being able to touch > see and experi ence 
are emphasized by each of them, 

Q, "What specific problems did you run into in Implementing your 
program?" 

Only one participant indicated difficulties related to her attempts to 
implement a program in her school. Her responses are, thus, not typical. 
However they do offer insight which is relevent to the objectives of 
the program. Her perceived problems were: 

- A resistance by the other teachers and administrators to average 
students entering higher mathematic and science courses. 

• Disbelief by teachers that minority students do not have the san)e 
opportunities to enter any field just as do their white counter- 
parts. 

• Disbelief by counselors that they have a tendency to counsel minorities 
out of science and math courses. 
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Conclusions: 



The majority of the participants could not identify problems related 
to implementing their programs. They, as later responses indicate, instead 
had no major problems in implementation. 



Q. "What is the extent of implementation of your program?" 



- One (1) participant indicated that she was using the program in 
her counseling only ; 

- Four (4) indicated that they had shared the information with other 
teachers and counselors in their schools and they were using it as well; 

• Two (2) had an organized program which was in operation; 

- Two (2) indicated that the program was in the planning phase for 
system wide implementation; 

- One (1) indicated that the program was, at the time of the follow-up, 
1n operation on a system wide basis; 

- One (1) indicated that planning was now in progress for a training 
program involving teachers and counselors. 

Conclusions: 



All of the participants indicated some degree of implementation of 
the program in their own schools or school systems, It appears that they 
have made efforts to share the information with others and to make maximum 
use of the training which they received. 



Q» "Vihat positive and/or negative coit)ments have you received from your 
immediate supervisor (s) about the program or its implementation?" 

Typical responses included the following: 

•"My immediate supervisor feels the program is good and has asked all 
counselors (city wide) to become involved in this type of effort," 

-"My supervisor feels that a pilot program using the materials 1 
have should be started iiranediately," 

-"My supervisors have been very receptive to the program," 

Conclusions ; 

It appears as though somo of the imniediate suparvisors were counsel or^. liienseUe^ 
They wore perceived by the pai^ticipan^s as syn.paihetic to the program and 
enthusiastic about implementation, For tlie most oart, supervisors have 
accepted the progran) as being a very high quality, and seeni pleased thai the 
participants were able to be involved, 
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Q. "Vlhat comments have your administrators made about the program or 
Its implementation?" (positive and negative) 



Typical comments: 

-''about half the administrators think the program is good;" 
-"Administrator was pleased with the meaningfulness and quality of 

the program and materials;" 
-"Administrators have been interested in the progress of the prograu;" 
-"Administrators have provided funds to take students on field trips." 

Conclusions : 

Most comments from administrators appear to have been positive. 
One participant, however, indicated receiving less than complete coope»-a- 
t1on from the administration. She suggested that many of the concerns 
which they (the administration) had were related to the lack of minority 
orientation and awareness in the school. 



Q- "What specific changes would you suggest in the training program 
to improve its effectiveness?^* 



Typical suggestions were; 

-"Provide a source book which lists the colleges in each state where the 
Allied Health programs are offered." 

-"Provide a booklet which explains the how and \/here of financial 
aid appl ication/' 

-"Limit the amount of time spent in certain aspects of the program 
so that more time can be spent in the clinical sessions," 

-"Schedule less counseling sessions or improve the quality of present- 
ations." 

-"Spend more time on the practicum." 

-"Avoid use of 'ready made* visual aids; produce relevant and current 

materials related specifically to the objectives of the program." 
-"Provide a session on visual aids geared to participants' needs . " 
-"Shorten the length of time (four weeks was too long)." 

Conclusions : 

Participants were willing to exclude other aspects of the program in 
favor of the cliu-ica] and praclicuni sections, Oii:cr suggestions related to 
content and niethcdology arc cccertcd without interpretation. 



"How do you perceive your program in the future?" 

• One (1) participant indicated that her program needed a great deal of 
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modification but that she vnll try to implen^ent it in the future, 

- One (1) participant suggested that her program has been* partially 
effective and that she will continue to use it in the future, 

• One (1) participant indicated that she is very satisfied with the 
program and looks forv/ard to using it in the future. 

- Three (3) participants indicated that their programs have been 
overwhelmingly effective and that they will be expanding in the 
future. 

Conclusions : / 

All respondents indicated some positive perception of the programs^ 
v/hich they had set up, as a future endeavor. Over half were overwhelmingly 
enthusiastic about their programs. 

Q. "What has been the reaction of the students you have worked with 
using the materials and techniques picked up from the Training Program?*' 



Conclusions : 

All participants indicated that moderate to great numbers of students 
had made use of the materials and techniques which were picked up at the 
Training Program, 



"How competent do you feel to counsel students when they have 
problems or questions in the Allied Health area?" 

Five (5) of the participants indicated that they felt very competent 
in counseling students who had problems or questions in the Allied Health 
area; one (1) indicated that he felt total ly competent. 

Conclusions : 

Participants seem to feel that they have achieved a level of expertise 
such that they are not afraid to attack problems in tliis area, As suggested 
in other sections of this report they feel that certain other materials would 
be helpful, however, this has not limited their feelings of competence in 
working with students. 



'*Vjhat specific questions have you felt inadequate to answer?" 

- One (l) participant was concerned that he did not feel cc):r,pctont to 
answer questions ^f^r F.tiKients related tc appl>ir:g for and receivinc 
financial aid for ?.tten(iinq an Allied Health school. 

- The remaining five (5) participnnis could not think of questions \nl'n 
which they v;cre not able to deal. 
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Conclusions : 



Participant competence level appears to be sufficiently high that 
even if they do not have answers, they do know where to go to find them. 



Q. "What materials would you like to see produced which would be help- 
ful to you in your counseling of students in the Allied Health areas?" 



Typical responses : 

- One source book with detailed information about all the Allied 
Health Careers. 

- Up-to-date and appropriate visual aids about the Allied Health areas. 



Q. "How have other faculty members in your setting become involved in 
the program you have established?" 



Response: included the foll?vinn: 

- I am in the process of setting up math and science laboratories 
to give remedial work in those areas; 

- The librarian has offered to help run a tutorial program by pro- 
viding space and supervision in the library for tutoring; 

- The principal is very involved in the process of developing the 
tutorial program; 

- Teachers have encouraged some students to seek the kind of information 
which I have; 

- Biology teacher is doing a unit on health careers using my materials; 

- English teachers are assisting students in writing for more in- 
formation on health careers; 

- Teachers have encouraged students to take science courses 
earlier to prepare for health careers; 

- The librarian has set up a health careers corner using my materials; 

- Teachers are co-sponsoring an Allied Hoalth Science Club; 

- Other counselors have given recommendations and suggestions for 
advuncing t!;e program. 

Conclusions : 

The interest of other faculty n. embers in the Allied Health Program 
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seems to be very high in most schools. Five of the participants indicated 
varying degrees of faculty interest in the program, All but one (1) 
participant indicated an on-going involvement by other faculty members. 

There is a very noticeable tendency for auxiliary programs to develop as 
a result of the participants sharing information with other teachers and 
counselors. 



"What contmunity resources have you made use of in relation to your 
implementation of the program?" 

- Brought in health career people to talk with students in a career 
activity; 

- Made contacts with hospitals and health facilities in the area to 
determine health resources; 

• Contacted volunteer health agency for placen^.ent of one of my students 
as a volunteer for this summer, 



"In general how do you feel about the clinical experience v/hich you 
had' in the Training Program?" 

The following responses were reported by the six the participants wno 
completed the follov/-up questionnaire: 

-"This part of the (Training Program) was excellent. There is not one 
from v/hich I did not learn a great deal;" 

-"Most of then were very informative and well . organized;" 

-"The clinicals provided (an) opportunity to see and related what was 
learned (during the Training Program.) The presentations and inter- 
action\in nost (cases) were helpful. Information shared and materials 
provided have been useful in my programs here in^^ ^ ;" 

-"The clinicals furnished me with the information I needed to discuss 
Allied Health Careers with students in the classroom and on an individual 
basis, I feel a very thorough coverage was made (of the material), and 
it has been very useful in motivating and counseling students;" 

-"Valuable for counselors or high school science teachers;" 

-"I feel that the clinical sections v;ere valuable in every way," 

Conclusions: 

The participonts am very positivr dhovt Uv.: clinical experience \/hich 

they had during the Training Program. They tclt that this section was best 

organized and presented of any of the mjor parts of the program, 
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Q* "In general, how do you feel about the counseling seminars in which 
you participated during the training program?'' 

The participants indicated the following responses: 

« Overall (the sci^iincirs were) very good, (Specifically), the career 
development (presentation was) excellent. Awareness of what one 
should get from the seminar and to whom the information was to be 
disseminated was good; it would have l^een excellent had (the pre- 
sentation) been in more depth* The (presentation) on how to deliver 
information did not take into consideration individual personalities 
nor specific settings. I have found the (section) on politicking 
(to be) valuable. I have found the pessimistic outlook of the 
speaker (who presented the topic) on the quality of students who 
come out of our educational institutions to be racist. The counsel- 
ing of the students from the local area was good in that it made 
the negative image which the counselor and science teachers (have, J 
real for me.). The information on cutbacks in counseling funding "'^ 
was enlightening. The section on interpretation of standardized 
tests for black students v/as good. 

- Some were good to very good but some were confusing and dis- 
couraging. 

* The career-interest questionnaire has been used with some modifications. 
Certain other specific materials have been put to use. 

- The counseling seminars provided me with additional techniques that 
have been helpful in stimulating student interest in Allied Health 
Careers . 

• (The roiin<;pling) wa<; helnful in that it made me realize what students 
expect from counselors and science teachers, 

- The seminars v/ero informative and have aided (me) tremendously with 
advising students (who have indicated an) interest in Allied Health. 

- 1 feel that the counseling seminars aided the perfonnance of the 
participants in the practicums. At the beginning of the tra'ining 
program I saw no need for them, but v;hen (preparing) for the practicum, 
1 understood how necessary they were. 

Concl usions : 

The participants were seemingly better able to appreciate the counseling 
seminars in retrospect. There were specific sections \.'hich tended to ap[JCal 
to each of them.. They indicate the applicability of much of what they learned 
to their jobs. 



'Mn general how do you feel about the practicum section of the 

Trainin'j PronrciM?*' 

The participants ir.clicotod tho folto\nnr| rci:;)0nscs: 

- It would heve been beneficial Lo have had the participants go throuvjh 
their (nrf^cticun) prev>on^c^ti 'jrr. with r^rh other l-pforp nresori'.inn thei,i 
to the (students). Also, it v;ould have been helpful hod we been given 
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a specific core of inforniation to present after discussing it with 
each othero I found tho vu!po-tape ( of the practicuni sessions) very 
.useful in help ing re to re alize tb<^ ^^■'' ny nijst ^'^^iNes I made. 

- The acceptencc and interest in the Allied Health Program in our 
school by students, teachers and administrators is a (direct) result 
of the practicuin experience. I don't feel I could have stimulated 
this degree of interest (had I not undergone) this special training. 

- (I feel that the practicum was helpful) in every way. 

. - J had no idea of the amount of infoniidtion I received during the 
Training Program until I began preparing for the practicum. It was 
very (helpful in) building confidence, I think it should be retained 
as an integral part of the training program, I propose (a practicuii) 
at tho college level and one at a 1 o\jer g rade level , 

- The practicum M\ih the use of vi deo-tape v/as a beautiful idea. 
The evaluation session helped me to use something from all of the 
presentations in my program. 

Conclusions ; 

The participants sav/ the practicum as a vehicle for pulling together 
all that they had learned during the training. They tend to admit that 
the practicum produced some tension in them, in that they were forced to call 
upon their experiences during the training end put them to work in a real 
setting. 

General Sunm^iry 

With the resDonse of the participants the evaluatorwas able to 
fomulate the "^ollowing program conclusions and suggestions. 



K The participants felt that a greater emphasis should be placed on the 
clinical sessions in organizing future training proqranis. 

The point is well taken. More and better organized clinical 
sessions should become a part of the training. However, the evaluator 
feels that this should not be done at the expense of or by diminishing 
the counseling sections* as many participants suggested. 

2. The participants were in agreeraent over the merits of the practicum 
section of the training. 

It is suggested that this section should be greatly expanded. The 
major cnphasis of the practicum came during the latter weeks of the 
program. Attention should be paid to providing more practicum 
experiences throughout tr£:ining. 
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The participants foU that the counseling sections were not 

adequately prepared or presented. 

There were a large number of significant but unrelated materials 
v/hi ch were required to meet the objectives of the program. 
To alleviate this problem in the fiiture, participants should 
be given a clear view of how each section is related to its 
parts and to the other sections as will. Some form of sunirnary 
session at the end of each day should be instituted. 

Participants were concerned about developments of a single source 
book which contained information about the Allied Health Careers, 
e.g. financial aid, colleges offering programs, media presentations, 
written materials, etc. 

Such a source book was developed (trainee's reference guide). 

Most participants were seemingly at a high motivational level with 
respect to their interest in implementing the programs in their 
home institutions. 

It is suggested that the program organizers keep contact with 
participants, providing materials and encouragement, until such 
time as programs are well established. Failure to do so may 
result in a decline of interest and enthusiasm. 



At least one participant seems to be well along 1n setting 
up a very viable program. Information on this individual's 
program should be shared with the other participants. Perhaps 
an on-site visit by the other participants would be an 

f\n nr on "i ;^tp rriorl>^>nT cm frvr ?cccr*pl 1 '^g this. 

The effectiveness of many of the participants' programs seer;:s to 
rest in their ability to get others in their settings involved. 

Some form of strategy should be developed for helping participants 
to get teachers, counselors and administrators involved in the 
program. Specific suggestions or "garr.e plans" should be 
designed which can be suggested to the participants in accomplish- 
ing this task. This was done as part of the training activity. 



63 

51 



On-Site (: valuations 



To evaluate the trainees* utilization of the assisting skills and 
infoniiation presented in the V'orkshop, cn-site visits to the participating 
Institutions were made. Some factors looked at durinq the visits were: 
past, on-gcing, and planned activities; administration support or constraints; 
evaluation by iini^ediate supervisors; student reaction; faculty involvement 
and reaction; self-evaluation. 

Institutions participating in the site visits: 
East High School 
Cleveland, Ohio 

South High School 
Cleveland, Ohio 

Clark College 
Atlanta, Georgia 

George W. Carver Senior High School 
New Orleans, Louisiana 

Booker T. Washington Senior High School 
New Orleans, Loui siana 

Scotlandville Senior High School 
Baton Rouge, Louisiana* 

Southern University 
New Orleans, Louisiana 

Tennessee State University 
Nashville, Tennessee 



Activities of the trainee: 

presentations to various groups^ e.g. teachers, counselors, 
conmunity groups, students, etc. 

establishment of Allied Health Careers Information Centers • 

several centers are located in school libraries 

establishment of Health Careers Clubs 

field trips to health facilities 

discussions among students and health professionals 

arrc^nginc] voluotoor surviccs L7 students in hoatth facilities 

film and slidp presentations; 

initiation of preliminary afrann^rcnts for establishment of 
tutorial services 

college-affiliated trninoes cngariod in rccrui tinont activities 
for their hcelth profo^sion proqr;i\'S. 

identified and contacted commiinity ciqoncies that could provide 
support and assistance to the troineer^' effort, e,n. cooperation 
vnth state hospital associations, cictivities in conjunction 
with Delta Sicjma Theto Sorority 

coordination o^ activities vnth health-related programs or 
organizations already existing in the school, e.g. moetinqs 
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with the Science Club, Home Economics Club, etc.; forming 
an alliance with the pratical nursing program 
participation in Career Week as presenter for Allied 
Health Careers 



Administration Support or Constraints 

Most school administrations were supportive of the activities* 
Some provided direct input in several of the activities and encouragGd 
further activities. Only two (2) principals appeared to be less than 
positive toward the efforts made by the trainees. Their concern was 
that the activities in allied health counseling may detract from the 
trainees' regular duties or functions. 

Some activities that the trainees had planned to Initiate were not 
in effect because school board approval was viewed as necessary* 
e.g. establishment of a course entitled "Introduction to Health Careers", 

Student Reaction 

The students interviev;ed seemed to be impressed with the presentations 
and activities of the trainees. One group of students remarked about 
their teacher's enthusiasm upon returning from the workshop. Several 
students in most schools participated in the allied health counseling 
after-school activities. In tv;o health clubs the students inquired 
about and sought positions as volunteers in local health facilities. 
In one hiqh school mor^ students than anticipated enrolled in the club: 
therefore, the students attended field trips and other outside activities 
on a rotating basis* 

Faculty Involvement and Reaction 

The majority of the trainees gave presentations to their faculty 
upon returning from the training program* Teachers and counselors 
expressed surprise and concern about the low number of minorities 
in the allied health professions* Many were supportive of the effort 
to increase minority enrollment in science and mathematics classes, but 
a few teachers, especially in science and mathematics, expressed a concern 
about lowering their standards and level of work when such students were 
admitted to more advanced classes. These same teachers in Cleveland 
disagreed with the need for tutorial services* They felt that this was 
a function of the student council only. 

In most instances, the faculty was supportive and aided in the 
establishment and development of many activities* Two examples: one 
teacher, registered os a r-jdical tochnoloqist , talked to the health club; 
one teacher's husband, a hospital adir.inistrator, arranged a tour of the 
facility for the health club. 



Overall the trainees did a good job in impleivontinq the skills 
and theories presented in the training program. As in most proqrans» 
there was one instance where the efforts v^ere less than what was expected. 
And of course there was one or two excellent examples where the student- 
trai neo-faculty-administration interaction v/as idcol. Southern University, 
New Orleans submitted a proposal dealing with allied health education 
in the New Orleans school system, with emphasis on George W. Carver 
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and Booker T, Washington High schools, Tennessee State University 
also submitted a proposal concerning allied health education. The 
trainee from one Cleveland school is working with the allied health 
education section of the school's new career educatic*- program, Booker 
T, Washington, New Orleans and Scotlandvi lie, Baton ' .^*^e have ex- 
tensive activities planned for health career clubs, ihe trainee at 
Clark Colleoe has traveled to several states recruiting for alii ' health 
training programs at Clark, The program at George W, Carver, I. . Orleans 
has had a slow start, but working with members of the school board 
has led to improvenents , One trainee in Cleveland has had several 
sessions vnth faculty and administration on the need for minority 
enrollment in the sciences and mathematics. 
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An Explanation 



You are about to begin an experimental proqram from which will 
evolve an innovative program for aiding in the career development 
of minorities. In order that we be able to indicate the process and 
Its effectiveness, it is necessary that you complete a questionnaire. 
It requires that you be as honest, thorough and frank as possible. 



Directions 



On the page following this sheet there is a place for you to indicate 
a code. T his is for reference purposes only , V)e are not int erested 
i n knowing your individual responses to the questionnaire . PLfASE 
CHOOSC A!iY FOUR DIGIT CODE WHICH YOU UOULO LIKE, AiiDlMlCE IT IN THE 
BLANK. Be sure to make a note or tnat code numbet bunicwotirc . Vou 
will be asked to use it again during the conference. 

Please complete each section before going on to the next, and do not 
change a response once you have gone on to another section. The 
questionnaire MUST be completed prior to the beginning of the first 
session Monday morning (January 6). 

Thank you, 

ISE Evaluation Staff 



08 

56 



CODE 

PLEASE COMPLETE THE ITEMS BELOW BY CHECKING THE ALTERNATIVE WHICH 
APPLIES TO YOU: 

1. What is your present job? Teacher Counselor Other 

2. In v/hat setting do you v/ork? 

Secondary College or Other 

School University (Specify) 

3. What was your college major? 

4. If teacher, what subject? 

5. If counselor, what is your responsibility 

6. Sex: tiale Female 

7. Number of years in present position 
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FOLLOWING ARE FOUR STATClfllHS DY FOUR riCTTTIOUS YOlinG PrOPLf . PLEASE 
REAn IHIIOUGH EACH STATiIlCNT CA^^EFULLY C'JT OUICKLY. ASSUl^T THAI THE IN- 
DIVIDUAL HAS MAOE fiir. STATf^iLliF TO YOU. "^'ir^!, FR-?' Af!Y FRAI'E OF REfERE: 

YOU CliOOSL, iNDi^jTF HO'j Yo:i I ^KiLOjO'":^^' OP Anvi!;r i!:r $TUOr':T. ^ 

VERY Sr^CIFIl. ^.R'ALLrDrSi".;! A COIiiM.rTE P^-lUCLlnr'T. VmCH \0U i'JGHT 
COnCLlYAr.LY USE lJEi(E YOU ACTUALLY FACL'n -IITM THE ['ROnLUU 



StatePient by a sixteen year old male: 



''The thing that is most difficult for nu? to understand, and the scariest 
too, is that I ro^Uy don't know what tc do vit^; my lite. I know what 
people expect n^.c to do. They 'want iT.e to become a toacher like dad. I 
really don't have any objection to teaching. It just seems like there, 
ought to be jnore for me. Like,> I really wont to think I have a little 
bit more to contribute. I'm going to collene, but this is the irost 
frightened I've ever been. I'm scared that 1 still won't kno\; wiiat to 
do after I've wasted two years and all thnt money. College is just too 
expensive to waste time on." 

/ 
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Statement of an eighth grade Black female: 



"I really haven't thought ve^y much abowt what TH do for a career, 
Tve got plenty of time to that. I've heard most colleges don't 
really care if you have a major when you get there as a freshman ♦ Til 
probably go into Dentistry or Mursing or something like that* Those 
are decisions I can make lajcii later. The immediate problem is to map 
out my courses in high school for the next four years » I want to take 
a language, and some music, for sure, 1 onlv want to take the minimum 
amount of math and science required to graduate froii] high scl^ooK I've 
heard you can pick up all those hard courses in your first year of 
college. " 
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Statement of a Black college junior: 



'*V/ell, you see, here's my problem. Pve got one more year to go in 
school, ril graduate with a 3.5 accum' and a major in mi cro^^iology. 
Tve applied to medical sci^col and have not been accepted, 11 I can't 
get into medical school, then Tve v/asted three years of my life. 
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Statement by a Black college freshman, 



"When I decided to go to college, I was so sure that I know v/hat I 
wanted to do. 1 even cieclared a major in ciicinistry during my first 

I haven't done that badly. In fact, you might as well kpo\/, 



quarter, 
I've done 
and math, 
them, I 
used to 
get the 
able to 



quite v;en. For that matter, I've always done vioU in y>ticnce 



The problem is that if 
don't know what I'll do wi 
think I might go into medi 
further off that possibil 
go to medi cal school . I 
twelve years to start earning a 
much about eilhcr one of them. 



I do decided to get a degree in one of 
th it when I finally do graduate. I 
cine or dentistry, hut the cider I 
ty gets. It would be preat to be 
just don't think I can vait ten or 



living. Any \'ay, I really don't kno\/ that 
Maybe I'll go to law school or something." 
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COMPLETE THE FOLLOIIING ITEHS BY IHDICATIIIG THE DIRFCTION AND DEGREE 
OF YOUR FEELINGS ABOUT THEM. CIRCLE THE NUMBER WHlCil BEST EXPRESSES 
YOUR KELIJIGS. 



1» There is not very much that a teacher can do to motivate students 
to enter one profession over another. 

strongly strongly 
disagree 3 2 10 12 3 agree 



2. I expect ISE to tell me specifically how I can recruit minorities 
into the health professions as the ir-ajor outco^ne of this conference, 

strongly strongly 
disagree 3 2 1 0 1 2 3 agree 

3. I have some very definite ideas about how minorities should be 
recruited into the health professions. 

strongly strongly 
disagree 3 2 10 12 3 agree 



4, The failure of minorities to attempt to enter the health protes- 
sions is primarily related to a fear of failure. 

strongly strongly 
disagree 3 2 10 12 3 agree 



5* There is very little which can be done to chanqe the psychological 
set which minorities have regarding the difficulties of entering 
the health professions. 

strongly strongly 
disagree 3 2 10 12 3 agree 



6. Using the mechanism of group interaction is an extremely effective 

way of counseling students about entry into the health professions, 

Stronnly strorqly 

di saqrce 3 ? 1 0 1 2 3 ac;ro^ 
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?♦ Making books, pamphlets and other written materials available to 
students about the health professions has been a very effective 
way of informing students about different occupations, 

strongly strongly 
disagree 3 2 10 12 3 agree 



8. At present 1 have a wealth of current knowledge about the many 
different health professions, 

strongly strongly 
disagree 3 2 10 12 3 agree 



9, I have a good working knowledge of group processes, 

strongly strongly 
disagree 3 2 10 12 3 agree 



10, The career development of minorities is essentially the same as 
that for the population as a whole, 

ctro^^^ly stronql V 

disagree 3 2 1 0 1 2 3 agree 



11, Given the opportunity, I would feel perfectly comfortable conducting 
a group experience with a group of students, 

strongly strongly 
disagree 3 2 10 12 3 agree 



12, I am aware of v/hat most career development specialist have to say 
about career decision niaking, 

strongly strongly 
disagree 3 2 10 12 3 agree 



13. I an owarc of ihc hicjh ^c:,0'0 rco/ji r*-^ '-".jits noco">^ary for entry 
into r.ost of t!ic health profr?.si on^ , 

strongly strongly 
disagroo 3 2 10 12 3 agree 
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14, I experionced many of the frustrations of making a decision about a 
career wnich most young adults today are experiencing. 



strongly strongly 
disagree 3 2 10 12 3 agree 



15, Young people today need counseling 1n social and psychological areas 
more so than in acadeniic areas. 

strongly strongly 
disagree 3 2 10 12 3 agree 



16, I am very happy with my own career choice. 

strongly strongly 
disagree 3 2 10 12 3 agree 



17. Most counseling of students, as it is now performed, is a waste of 
time when it comes to helping them to make decisions about a career, 

strongly strongly 
disagree 3 2 10 12 3 agree 



18. Elementary and secondary education for minorities needs to get back to 
a strict attention to the three R*r> and away from attempting to meet 
personal needs of students. 

strongly strongly 
disagree 3 2 10 12 3 agree 



19, If I can develop a detailed program for counseling and recruiting 
minorities in the health areas, I am confident that I would get 
backing fro'v. my superiors in setting it up at my home institution. 

st>^ongly strongly 
di sagree 3 2 1 0 1 2 3 agree 



20. I feel this four !,;oek '/ill be vr-ry ^on^^fic;?! in oivinn 

mo skilU. in helping stur^onts to ^.^t'f^ caroor d^ci$;iorr. . 

strongly strongly 

disagree 3 2 10 12 3 agree 
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IDENTIFY AS MANY AREAS AS YOU CAN WHICH FIT UNOf.R THF HEADING 
HEAL TH PROFESSIO NS. PLACE A CHECK IN THE BOX TO THE LEFT OF THOSE 
WHICH YOU FEEL YOU HAVE SUFFICIENT INFORMATION OH WHICH TO COUNSEL 
STUDENTS . 

1 . 

2. 

3. 

4. 

5. 

6. 

7. 

8. 

9. 

10. 

n. 

12. 

13. 

14. 
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mm ARC LISTEn SOf^C POSSIGIE BAPRIERS WHICIi PRCV^HT f'lriORITIES FRCn 
FlUERING Tin: HfALTH Pi'Orr.SSI 0:i5 » HEPD TliROUGl! TIIF LIST AIJO CRFCK TI!F THREE 

WHICH YOU Tni:;;( have t;'!: ;:ost iiiFLurncE o;i :i];:o^;itifs 1:07 rjjTFRUiG the 

HEALTH PR0Fi:S3I0N5, OIXL YOU HAVl CHOSEN fr'V:]^ DCCIDF.U WHICH ONE IS !^OST 
INFlUrNTIAl AND PLACE THE VUrBER ONF Q)^ BLSTnt THE ITLM, THE NUM'^ER Ti ;0 {?.) 
BC"SIDE THE SFCOND liOSl UIFLUENTI ALTaIID THE Mi'-oH^. THR^F BESIDE THE THIRD > 

IF YOU KNOW OF OTHER BARRIERS ADD THLM UNDER OTHERS ANB RANK THEM JUST 
AS ABOVE. 

Minorities do not enter the health professions because of: 

1» Irrational fear of scientific disciplines 

2. Lack of educational background 



3» Lack of adequate information on these areas 



4, Lack of financial support 

5. Institutional efforts to keep them out 



6» Lack of encouragement from home 

7. Lack of encouracjoment from teachers and counselors 



8. Lack of inner motivation 



9» Other (specify) 



10» Other (specify) 



]] » Otiier (specify) 
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THIS CONFCRCNCr IS OrSIGNLO 10 PROVIDE YOU VIITI! IKFORMATIOl! WHICH 
WILL HELP YOU IN FOPylUl -MI!;'. SOMC WSkS ABOUT UIl FROIMJ'! OF RECRUIT- 
IMG, ADVISIIM OR COb'ol.l.IJIG MIIIORITIES INTO HIE HEALTH i-ROFESSIOK'S. 

BEFORi: entf.ri:;g the ccrin ri.'icn rnccrss v;e woiiio like for you to ForviiuLATf. 

YOUR PERCEPTK'NS Of THE l-V.OCLEM AND ITS SOLUTIO!!. PLEASE PROVIDE CA'iDID 
RESPOtlSES TO THE FOLLOWING QUESTIOIIS. 



In as many words as you feel are necessary, define the problem. 



Provide what you see as a solution to the problem. 
(Actually organize a program for solving the, problem) 
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AN EXPLANATION 



Now that you have coniplet^^d the conference process, you are probably 
organizing soroe things in your mind. Just this same process is going 
on with the conference organizers. To aid in this process we need to 
have you complete this post conference questionnaire. It requires that 
you be as honesty thorough ond frank as possible. 



Directions 



On the page following this sheet there is a place for you to indicate 
a cede. You c!^o*^? *^nrh a fonr digit rode at the beqinning of the con- 
ference. Record that number at the top of the page. 



Please complete each section before going to the next, and do not change 
a response once you have gone on to the next section. The questionnaire 
MUST be completed before you depart the conference. 



Thank you, 



ISE Evaluation Staff 



Hi 



CODE 



FOLLOWING ARE FOUR STATCMENTS BY FOUR FICTITIOUS YOUNG PEOPLE. PLEASE 
READ THROUGH EACH STATLnCHT CAP.EFULLY BUI tiUlCKLY. ASSUME THAT THE 
INDIVIDUAL HAS THE STATEl^NT TO YOU. THEN, FRO:i ANY FRAl'iE OF 
REFERENCE YOU CHOOSr, iriDICATr WiV YOU rOULl) rjmSU / \DVISE T HE 
STUDENT, " 



iE VERY SPi:CiriC. 

WHICH YOU 'KlGfiT C0;ia:ifAl3LY 
PROBLEM, 



ACTUALLY DESloii A CU'PLLIE PROCEDU^^E 
USE WERE YOU ACTUALLY PArED WITH THE 



Statement by a sixteen year old male. 



"The thing that is inost difficult for me to understand and the scariest, 
too, is that I really don't know what to do with my life. 1 know what 
people expect me to do. They want me to become a teacher like dad. I 
really don't have any objection to teaching. It just seems like there 
ought to be more for mc. Like, I'd really want to think I have a little 
bit more to contribute. Tm going to college, but this is the most fright- 
ened Tvc ever been. Tm scared that I still won't knov/ what to do after 
1 We wasiec) two ytiai b <tMd all limt mor.cy, 
to waste time on. 



V/ U t ♦ V, y 



*st too ex*^'^'^^ i 
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Statfm?nt of a Black collogc student r 



"Well, you see, here's ny problcin, I've get one M^irr^ year to in 
school, rn graduate witl. a"j,5 accuin" cnrJ a nejor microbio'ogy. 
I've applied to i^cJ^.cal school and havo not been accontcd. H I 
can't get into medical school, then I've wasted three years of my 
life/^ 



H 3 



Statement by a Black college froslvnan: 



"When I dcxided to c-o to college, I \;as so sure that I knew what I 
v/anted to clo. I even rieciared ci piajor ,in che^r.islry during my first 
quarter. I haven't doiv^ that badly. In fact, you iiiight as well Im.ow, 
I've done quite well. Tor that niattcr, I've al\;ays done v/ell in 
science and r.iath. The problein is that if I do decide to get a dcoreo 
in one of thein, I donM know what m do v:itii it v/hen I finally do 
graduate. I used to think I micjiit go into ixaicinc or donti*^try, but 
the old(?r I qet the farther off that posslbilliy gets. It would bp 
great to be able to ^^o to niedical school. I just don't tiiink I can 
wait ten or twelve rs to start earning a living. Any way, I riv^^lly 
don't know that much enout eithci^ one of thcni. Paybe I'll go to law 
school or scinethi ng. " 



COMPLElL IWf. FOLIC iiiG ITEMS L>Y IliOICATIKr THf I.CTIOW AND 0^ Cl-^LT, OF 
YOUR Fr.LlIi^GS ABOUi THFJl. CI!XLE THE r;U;:::Lrv i,! . r.r.T EXPRESSES fOUR 
FEELINGS. 



1. There is not very iv.uch that a teacher can do to iriotivate students to 
enter one profession over ar.other. 

strcpcjiy strongly 

di sogree 3 2 1 0 1 2 3 acjree 



2. This conference provided irio with specif ''c informaiion on ho'/ 1 can 
establish a proyrair- for recruiting minorities into the health profes- 
sions. 

stronQly strongly 
disagree 3 2 10 12 3 agree 



3, I have gained so;;e vr-ry definite ideos about the problems \;hic!i 
ninorities face in entering the health professions, 

strongly strongly 
disagree 3 2 10 12 3 agree 



4, The failure of minorities to atte^npt Lo enter tiie health professions 
is primarily related to a fear of failure. 

strongly strongly 
disagree 3 2 10 12 3 agree 

5. There is very little which can be done to change the psychological 
set which minorities have regarding tfio difficulties of enteriitg the 
health professions. 

strongly strongly 
disagree 3 2 10 12 3 agree 



6, Using the niechanis;^; of'qroup i nteraction"is an exireisely effoeiive 
way of counseling students about entry into the h'^-altli professions. 

Slrf^r^O V stror.'ilv 
dv.<uirce 3 2 1 0 1 f! 3 aqrco 
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7. Making books, puiiiphlets and other \,ritten materials available 
to students ahuul the licalth professions has !>ecn a very effec- 
tive way of mionning students about different occupations, \ 

strongly strongly * ' - 

disagree 3 2 1 0 1 2 3 agree ^ : 

8. I have a v/eal'ch of currcjit^ knowledge about the ti.auy different 
health profoscions . 

strongly strongly 
disagree 3 2 10 1 2 3 agree 

9. I liave a good working knowledge of group processes. 

strongly strongly 
disagree 3 2 1 0 1 2 3 agree 

10, The career devolopnient of minorities is essentially the same as that 
for the population as a whole, 

strongly strongly 
Hi <;rinrpe 3 ? 1 0 1 2 3 aoree 

11, Given the opportunity, I would feel pc-fectly coruf o)^tablc conducting 
a"group expericnLc"with a group of slud&nts,^ 

strongly strongly 
disagree 3 2 10 12 3 agree 

12. I am aware of i:hat most career devclop:riont specialist have to say 
about career decision n^dking. 

strongly strongly 
di sagree 3 2 1 0 1 2 3 agree 

13. I am aware of Lhe high school rcquirr;onts necessary for^ entry into 

s trongly Surr^: rly 

disagree 3 2 10 1 2 3 agr^^'e 



14. I o;Kporioprrcl pMnv of tro frustrolion^ of '■'il'.r.(i a decision 

about a career hich i,;n<:t young a^ciusl:. tO(ioy ^'--'c c^pen cii' ii^ 

stronqly stronqly 

disagree 3 2 l 0 1 2 3 a^^rr^e 
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15. Young people i^^'i'cy necci counseliiicj in social and psychological areas 
more so III an in academic areas. 

stror»n1y strongly 

di sagree 3 2 1 0 1 2 3 agree 



16. 1 am very liapny u'ith iiiy ov/n career choice. 

strongly strongly 
disagree 3 2 10 12 3 agree 



17, Most counsel ir.Q of stu<.lcnts, as it 
time v/hen it cor:os to helping thein 

strongly 

disagree 3 2 10 



is now perfor'^od, is a v^aste of 
to make decisions about a career. 

strongly 
1 2 3 agree 



18, Elementary and secondary education for minorities need to get back 
to strict attention to Xho three R's and away from attenuating to 
meet the personal needs of students. 

strongly strongly 
di saqree 3 2 1 0 1 2 3 agree 



19. 



If I can develop a detailed program for counseling and recruiting 
rr.inorities in tlio healt!) areas, I ani confident that 1 would net 
backing from niy superiors in setting it up at rny home institution, 

strongly strongly 
disagree 3 2 10 12 3 agree 



20, 1 feel that this four week program has been very beneficial in 
giving skills in h.elrnnj studenLs to ::;akc career dccision<. 

strongly strongly 
disagree 3 2 10 12 3 agree 
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LIST THC 'W'^'y, ARCA^ "fiicH vcu co;;siDf:!; TO i;f !*cst sir\iriu\riT iii the 

FAILURE Of l.'il.ORrilLb 10 CMlK liiL IICALTli r.sOf ISSil^sV^ " 

Most Significant 1. 

Second Most Significant 2. 

Third Most SignificdiVv 3. 



BrLOW UiDlC'^TL HC'.J VCL' TLTl ADOUT VQUR FX^TP/'I'CF.S Of VM' PAST TOUR l.'CEKS, 

RCSPONJ i:: si'CH a v7V AS TO i::;>icatl the DirrcTiori A:;n Drnr/iE or volt. 

FELLIIiGS O.j EACH OF IMF PROCESSES. 

1. The scniinar topics were, 

very irrelavant 3 2 1 0 1 3 very relevcint 

2. Ttte seminar preso:iters v/ere 

poor 3 2 10 12 3 excellent 

3. The ccn'^erence was, 

poorly organucd 3 2 1 0 1 2 3 well organized 

4. The conference setting was, 

poor 3 2 10 12 3 excellent 

5. The n'aterials passed out wore, 

irrel event 3 2 1 0 1 2 3 vg)7 relevoJ^t 



^ T ' 1 r , - 

u . I / 1 e ; . H o ^ ■ 



2 1 0 1 ? 3 ATv nc 



1 [j i i; I 



7. i'.y ccc^ 



poor 



3 2 10 12 3 



excel lent 
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INDICATC rCR EAC!! Of TliE liCALTIi CA"rERS LISTF.D CCLC',.', Tlil. WiPl-lTLi^CL 
LEVEL KHICH YOU HAVT. IK CGU NSl.Li i;C STUDLIITS'. 



No Average \ High 

Co:v,petence Comoetcnce ' Competence 

1 2 3 4 5 6 7 



E 1 e c t r 0 c n c G p h a 1 0 g r a ! i ! ' i c 




1 












Inhalation Technician 
















Inhalation Therapist 
















Ootoinplric A*^iSist-nt 
















Optometri st 








1 












Dental Hygienist 

















I'lcdical Lctboratory 
Techno 1 oqi st 
















1 


MofHrr^l Tf^rbi nol DOT ^ t 

















Cytotechno1o:jist 
















Medical Assi stant 
















Medical Px-cord 
Technician 
















Medical [ ^'Cord 

Adtuinisiratcr 
















Certi f ied Techmci en 
















Radiolog ic 

Teclino1")^n St 
















Ti ri^];-.l:;K.t 
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No Av( : '^le Hi^jh 

Conipetence Conipc I rnce Competoncc 

1 2 3 5 G 7 



Electrocardiograph 
Technician 
















uen ti b t 


















Pharmacist 
















UpttratlP.g KO0»u 

Tecimician 
















Physical Therapist 
















Assistant 

















V c LcF t Ma i 1 cf 1 
















Dietetic Tcchnicicin 
















Sani tarian 
















Dietitian 






Registered u'urse 
















Licensed j^ractical 
NursB 
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APPENDIX C 



CODE 



DATE 



Directions: In order to evaVjate the different ccnference dctivit"ies while 
they are fresh in you nnnd, the evaluation staff v/ould like for you to 
complete one of tliosc shori questionnaires for each of the conference serpinars 
or workshops. You should tvrn in each days qucr7tio"*nnaires at the first 
session of the succeedinq day. 



Title of seminar 



Presenter 



The presenter wcs 

poor 

The material was 

irrelevant 

The material was 

very uninteresting 

The session as a whole 

did not fullfill 
any of ny needs 



3 2 10 12 3 



3 2 10 12 3 



3 2 10 12 3 



3 2 10 12 3 



excellent 



very relevant 



very interesting 



fullfilled many of 
my needs 



Use this space to make any comments you might wish to make concerning 
the seminar or v/orkshop: 




POSl-CONFERrNCE RE-CVALUAT ION OF 
PRCSLNTAIOuS 



Attached are identified the seminars and presentations which were 
a part of the training program. Please go through and re-cvaluate 
each as honestly as you can. 
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Clinicals 

lioalth Care Adnnnislration and Planning 

PO_siMv-' tf'incjs stick in your nrind abouL the pros^nto lion? 

a. 

b. 

c . 

Vihat ngcativo things stick in your mind about the presentation? 

a 

b. 

c» 



Introductory Group Marathon 

1, What pQsi ti VP tinnjs stick in your '.ind about the presente tion? 

a, 

b, ^ 

c , 

2. What po^:nti vc things sticL in your mind about tho presentation? 

a. ; 

b. 

c. 
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It: 



I 
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Allied He^iith Gbunselor Counseling Technique 
Evaluation Form 

INSTRUQTIONS : Carefully read the responses made by each of the 
garlaicipants to each of the student statements. Then complete 
one^ of these forms for each response for each participant, 
(You .should complete four (4) of these forms for each parti^- 
.fiipant) Check the response which best applies. 

Does the counselor seem to have a clear theoretical or ientatioii? 

_v ery clear 

.c lear 

h ot at all 

2i :J:s there a linear progression toward meeting the student's heeds? 

_^v ery clear linear progression 

l.l^^A inear progression 

___h6 evidence of linear progression 

3. Is the approach used by the counselor creative? 

— v ery creative 
___a standard approach 
___hot an acceptible approach 

4. Does the counselor indicate a knowledge of reference materials/ 
persons available to the student? 

■ very clearly knowledgeable 

. some knowledge 

not knowledgeable at all 
5i Is there a heaith-care-occupations-orientation evidenced by 
the counselor in working with the student? 

___very health care occupations oriented 

some health care occupations oriented 

no health care occupations orientation at all 
6i is there an identification of the student's problem as a minority 
career decision problem? 

___clear identification 
c ursory identification 
no identi f icati.on 

7* in v;hich of the fo3 1ov;ing coun?;olin9 avoaf: is the cotinselv^r 
most Incl; ing? 

^ ^technique 

theory 

. information 

sensitj.vity 

(other) identity ^ 
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